Possibility and Impossibility of the Entropy Balance in Lattice Boltzmann Collisions 
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We demonstrate that in the space of distributions operated on by lattice Boltzmann methods 
that there exists a vicinity of the equilibrium where collisions with entropy balance are possible 
and, at the same time, there exist an area of nonequilibrium distributions where such collisions are 
impossible. We calculate and graphically represent these areas for some simple entropic equilibria 
using single relaxation time models. Therefore it is shown that the definition of an entropic LBM 
is incomplete without a strategy to deal with certain highly nonequilibrium states. Such strategies 
should be explicitly stated as they may result in the production of additional entropy. 



I. INTRODUCTION 

Lattice Boltzmann schemes are a type of discrete al- 
gorithm which can be used to simulate fluid dynamics 
and more 0, [13. Although such a method can be de- 
rived as a discretization of the fully continuous Boltz- 
mann equation, some thermodynamics properties may 
be lost in this process. The Entropic lattice Boltzmann 
method (ELBM) was invented first in 1998 as a tool for 
the construction of single relaxation time lattice Boltz- 
man models which respects a _ff-theorem [l5|. For 
this purpose, instead of the mirror image with a local 
equilibrium as the reflection center, the entropic invo- 
lution was proposed, which preserves the entropy value. 
Later, it was called the Karlin-Succi involution 

Nevertheless, controlling the proper entropy balance 
remained until recently a challenging problem for many 
lattice Boltzmann models [l^ • Some discussions of mod- 
ern ELBM implementations and results were published 
recently 

The distribution functions at the centre of lattice 
Boltzmann methods are often referred to and understood 
as particle densities. Of course for such an interpreta- 
tion to be meaningful the distribution function should be 
strictly positive. Despite this some lattice Boltzmann im- 
plementations may, as a numerical scheme, tolerate neg- 
ative population values. An ELBM usually involves an 
evaluation of a Boltzmann type entropy function, which 
does not exist for negative populations, hence such an 
ELBM cannot ever tolerate a negative population value. 
Due to this there are population values for which an en- 
tropic involution cannot be performed. A complete def- 
inition of an ELBM must include a strategy for what 
to do in such a situation. The choice of such a strategy 
should be explicitly given in any definition of an ELBM as 
it may have side-effects with modification of dissipation 
which should be understood separately from the influence 
of the proper entropy balance. 

In this paper we study the regions in the spaces 
of distributions (populations) where collisions with en- 
tropy preservation are possible (near the equilibrium) 
and where they are impossible (sufficiently far from the 
equilibrium) and demonstrate that both such areas al- 
ways exist apart some trivial degenerated cases. 



II. SINGLE RELAXATION TIME LB SCHEMES 



For fluids, LB systems can be derived as a discretiza- 
tion of the Boltzmann Equation 



dtf + ^-d^f = Q{f) 



(1) 



where / = /(x, v, t) is a one particle distribution function 
over space, velocity space and time and Q{f) represents 
the interaction between particles, sometimes called a col- 
lision operation. A particular example of the interaction 
Qif) is the Bhatnagar-Gross-Krook equation 
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The BGK operation represents a relaxation towards the 
local equilibrium f°'^ with rate l/r. The distribution /'"^ 
is given by the Maxwell Boltzmann distribution. 
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The macroscopic quantities are available as integrals over 
velocity space of the distribution function. 



v/ dv, pu^ + pT = v^f dv. 



/ dv, pu 



A discrete approximation to these integrals is the first 
ingredient to discretize this system. The scalar field of 
the population function (over space, vector space and 
time) becomes a sequence of vector fields (over space) in 
time /i(x, ri( e),nt G Z, where the elements of the vec- 
tor each correspond with an element of the quadrature. 
Explicitly the macroscopic moments are given by. 



fi: pu 



•Vifi, pu + pT 



1=1 



The complete discrete scheme is given by 

/, (x + ev,; , t + e) = /, (x, + ^ (/r (x, i ) - /. (x, i ) ) (4) 

where e is the time step. For this system a discrete 
equilibrium must be used. The choice of the velocity 
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set {vi, . . . , v„} and the discrete equilibrium distribution 
f^'^ should provide the best approximation of the trans- 
port equations for the moments by the discrete scheme 



III. ELBM 

In the continuous case the Maxwellian distribution 
maximizes entropy, as measured by the Boltzmann H 
function, and therefore also has zero entropy production. 
In the context of lattice Boltzmann methods a discrete 
form of the i7-theorem has been suggested as a way to 
introduce thermodynamic control to the system 0, [lO| . 

A variation on the LBGK is the ELBGK In this 
family of methods, the equilibria are defined as the con- 
ditional entropy maximizers under given values of macro- 
scopic variables {entropic equilibria). The entropies have 
been constructed in a lattice dependent fashion in [o^ . A 
slightly different notation is used for the lattice Boltz- 
mann algorithm, 

/. (x + ev„ t + e) - /, (x, t) + aPifP (x, t ) - /, (x, i) ) . (5) 

The single parameter uj is replaced by a composite pa- 
rameter a/3. In this case /3 controls the viscosity and a 
is varied to ensure a constant entropy condition accord- 
ing to the discrete _ff-theorem. With knowledge of the 
entropy function S, a is found as the non-trivial root of 
the equation 

Sit) = S{i + a{r -{)). (6) 

The trivial root a = returns the entropy value of the 
original populations. ELBGK then finds the non-trivial 
a such that ^ holds. This version of the BGK collision 
one calls entropic BGK (or EBGK) collision. A solution 
of (|6]) must be found at every time step and lattice site. 
The EBGK collision obviously respects the Second Law 
(if /3 < 1), and simple analysis of entropy dissipation 
gives the proper evaluation of viscosity. 

In general the entropy function is based upon the lat- 
tice. For example, in the case of the simple one dimen- 
sional lattice with velocities v = (— c, 0,c) and corre- 
sponding populations f = (/-,/o,/+) an exphcit Boltz- 
mann style entropy function is known [9|: 

5(f) = log(/_) - /o log(/o/4) - /+ log(/+). (7) 



IV. REGIONS OF EXISTENCE AND 
NON-EXISTENCE OF ENTROPIC INVOLUTION 

Let us study the entropic involution in the distribution 
simplex E given by ^ = const > 0, /i > 0. 

Let us prove that under very natural assumptions 
about some properties of the entropy that the simplex 
of distributions can be split into two subsets A and B: 



in the set A the entropic involution exists, and for dis- 
tributions from the set B equation ([BJ has no non-trivial 
solutions. Both sets A and B have non-empty interior 
(apart of a trivial symmetric degenerated case). 

Let the entropy 5 be a strictly concave continuous 
function in the distribution simplex E. We assume 
also that S is twice differentiable, the Hessian of S, 
d^S/dfidfj, is negative definite in the interior of the sim- 
plex, E_|_, where /» ~ const, fi > and the global 
maximizer of 5*, the equilibrium, belongs to the interior 
of the simplex. 

For example, the relative Boltzmann entropy, S = 
~ /i(ln(/i/Wi) - 1), Wi > 0, satisfies these con- 
ditions, because /In/ when f and 
d^S/dfidfj — —Sij/fi, whereas the relative Burg entropy 
S = ^ Wi(ln(/i/Wi)) does not satisfy these conditions 
because it does not exist on the border of the simplex. 

Macroscopic variables are linear functions of f . The 
sets with given values of the macroscopic variables in 
the simplex E are polyhedra, intersections of S with lin- 
ear manifolds with the given values of moments. We as- 
sume that in any such a polyhedron the entropy achieves 
its (conditionally) global maximum at an internal point. 
This assumption holds for the Boltzmann relative en- 
tropy because of the logarithmic singularity of the "chem- 
ical potentials" fii = hi{fi/Wi) on the border of positiv- 
ity. These maximizers are equilibria. If f is sufficiently 
close to a positive equilibrium then, due to the implicit 
function theorem, the nontrivial solution to equation ^ 
exists and it gives a = 2 + o(f — f*). The value a — 2 
corresponds to the mirror image, the small term o(f — f*) 
gives the corrections to the value a = 2. Therefore, in 
some vicinity of the equilibrium the entropic involution 
exists. 

To prove the existence of the area where entropic invo- 
lution is impossible, let us consider one polyhedron with 
given values of the macroscopic variables and a positive 
equilibrium. The local minima of the entropy in this 
polyhedron are situated at the vertices. At least one of 
them is a global minimum. Let this vertex be f^. Let 
us draw a straight line I through points and f*. The 
intersection / n S is an interval and S achieves its global 
minimum on this interval at the point f^. If the dimen- 
sion of the polyhedron is more than one then the opposite 
end of this interval is not even a local minimum of S in 
the polyhedron and the entropic involution does not ex- 
ists for and some vicinity around it. 

A special degeneration is possible when the polyhe- 
dra are one-dimensional, i.e. intervals, and the values of 
the entropy at both ends of each interval coincide. For 
example, for two-dimensional distributions, /+,/_, the 
entropy S == /+ln/+ — /_ln/_ and the macroscopic 
variable p = f+ + f-- Apart from such symmetric one- 
dimensional cases there exists an area near the maximally 
non-equilibrium vertex where the entropic involution 
cannot be defined. Such an area may also exist near some 
other vertices, where local entropy minima are reached. 

For the Burg entropy, the entropic involution is always 




FIG. 1: The simplex E is given by the white background. (1) Populations relax through the equilibrium given by the single 
point to an equal entropy point, if possible. The boundary of this possibility is given. (2) The regions A (the entropic involution 
is possible) and B (the involution is impossible) as subsets of the simplex divided by this boundary are presented. 



(1) 



/ u = Constant 

- - S = Constant 
— e — Equilibrium 
Possibility Boundary 





FIG. 2: The simplex E is given by the white background. (1) Populations relax through the their corresponding equilibrium 
point along the line given by constant u to an equal entropy point, if possible. The boundary of this possibility is given. (2) 
The regions A and B separated by this boundary are presented. 



possible [3| because it tends to — oo at the border of pos- 
itivity. The same is true, for the relative entropy of the 
form S = -/3-'^J2Wi{{Wi/fi)^ - 1) that tends to the 
Burg entropy when /? — > 18|. This negative brunch of 
the relative Tsallis entropy is less known. The standard 
Tsallis entropy [l^ is finite at the border of positivity, 
hence, collisions with entropy preservation are not always 
possible for it. 

We now demonstrate the population function values 
where the involution cannot be performed for some sim- 
ple examples. We use the standard 1-D lattice described 
in Section IIIII with the discrete equilibrium given in Eq 



[T] We begin with an LBM with only one conserved mo- 
ment in collision, namely density. The equilibrium is 

p £df 2p p 

— 6' JO ~ 31 J + ~ 6' 

In Fig. [U the simplex E of positive populations with 
a fixed density p = 1 is the triangle given by the in- 
tersection of three half-planes, > 0, /~ > 0, and 
1 — /+ — > 0. Within that region we plot several en- 
tropy level contours S'(f) = c and the unique equilibrium 
point. The region is divided into the parts where the 
entropic involution is possible (around the equilibrium) 
and where it is impossible. 

A more common use of lattice Boltzmann involves a 
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second fixed moment, momentum. The entropic equilib- 
ria used by the ELBGK are available explicitly as the 
maximum of the entropy function ([7]) , 



/; = ^(t3^^ - 1 + 2v/l + 3u2), f* = -£{2 - v/TTs^). 

In this case the dimension of the equilibrium is one 
greater. In Fig. [5] all relaxation occurs parallel to the 
lines of constant u. The region where entropic involution 
is possible is again given. 

In each experiment the region is discretized into many 
individual points. For each point a value for a is at- 
tempted to be found. The method used is simply to 
begin with a guess of a = 1 and then add increments of 
10~'^ until a solution of Eq. [5] occurs, or the edge of the 
positivity domain is reached. This method would be in- 
appropriate to use in a usual ELBM, due to the very large 
computational cost, but it is very robust and hence use- 
ful for this experiment with many higly non-equilibrium 
distributions. Another approach (with the same result) 
implies calculation of the entropic involution for all the 
boundary points where it exists. In this method we draw 
a straight line I through a boundary point f and the equi- 
librium and find the intersection I n S which consists 
of all points on I with non-negative coordinates. One 
end of this interval is f , another end is also a boundary 
point, f. The entropic involution for f exits if and only 
if S'(f)' < <5'(f). After we check this inequality, we can 
solve Eq. ©. The images of these involutions form the 
border that separates sets A and B (see Figs). 

V. CONCLUSION 

The entropic involution is not always possible to per- 
form. We have demonstrated that apart some special 



one-dimensional spaces of distributions with additional 
symmetry there exist domains where collisions with the 
preservation of entropy are not possible. We illustrated 
this statement by some simple and well known examples 
of ELBGK systems for which we directly calculated the 
areas where entropic collisions exist and where they do 
not exist. 



Such phenomena should be observable in all ELBM 
schemes with the classical entropies: there exists a vicin- 
ity of the equilibrium where the entropic involution is 
possible but for some areas of non-equilibrium distribu- 
tions there exists no non-trivial root of equation A 
collision which preserves entropy does not exist for this 
area. Therefore, for the regimes close to equilibrium (the 
vicinities A of equilibria. Figs 1,2), ELBM schemes guar- 
anty the precise balance of the entropy and for more 
nonequilibrium regimes, when at some sites the distri- 
bution belonges to sets B, ELBM schemes work as lim- 
iters 0- with additional dissipation. It is necessary for 
any complete definition of an ELBM algorithm to pre- 
scribe what to do when the involution is not possible. A 
reasonable choice would be to over-relax the maximum 
amount possible while maintaining positive population 
values. Such a technique is independently in use as a sta- 
bilizer for lattice Boltzmann schernes. sometimes called 
the 'positivity limiter' 0, S, [H [13, [ll ■ An effect of this 
operation is a local increase in viscosity /entropy produc- 
tion. Hence, if an ELBM were to apply such a scheme 
it would necessarily break the proper entropy balance. 
In this sense, ELBM belongs to a large family of add-ons 
that regularise LBM by the management of the addtional 
dissipation Q. 
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